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ABSTRACT 



The impact of the Katz/Henry Faculty Development Model on 
teaching behaviors and student learning outcomes was assessed with 24 faculty 
members at 4 i.isti". j in New Jersey. This model, known as "Partners in 
Learning" involved: faculty pairs who observe one anouhv^i'i.: class, partner 
meetings to discuss shared experience in the classroom, several interviews 
with at least three students, and meetings with other faculty participants on 
campus to discuss experiences. Data on learning outcomes, teaching behaviors, 
and collegial interactions were collected for three years at four diverse 
institutions in New Jersey. Students completed pre- and post- tests which 
examined their preference for class structure and teaching style, their 
interactions with faculty, student changes resulting from the course, and 
academic skill development. Faculty were evaluated at least three times per 
semester to document clarity, enthusiasm, interaction, organization, pacing, 
disclosure, and rapport. Syllabi were examined, and faculty attitudes about 
their classroom experiences were surveyed. While no discernible increase in 
student academic achievement was found, the data indicate enhanced faculty 
understanding of student learning, improved relationships with colleagues, 
and increased changes in classroom teaching. Appendices include: student pre- 
and post- tests, classroom observation protocols, a syllabus checklist, and a 
faculty survey. (SW) 
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Project Overview 

The New Jersey Institute for Collegiate Teaching and Learning (NJICTL) assessed 
the impact of the Katz/Henry Faculty Development Model (known as “Partners in 
Learning” or PIL) on the teaching behaviors and student learning outcomes of 24 faculty 
members at four diverse institutions in New Jersey. Data on short term and long term 
learning outcomes, teaching behaviors, and collegial interactions were collected from a 
variety of sources over a three year period. The data showed that participation in PIL 
enhanced faculty’s understanding of student learning, enhanced their relationships with 
colleagues, and caused them to make changes in their classroom teaching. Despite these 
critical self-reported changes, there were no discernible patterns of increased student 
academic achievement in the focal courses. 

Purpose 

This project afforded an opportunity to assess teaching behaviors from the 
students perspective, the individual faculty’s perspective, and the collective faculty’s 
perspective. It documented the ways in which faculty development efforts can alter 
classroom performance, and in some cases, permanently change the way faculty go about 
teaching their courses. It also provided a framework within which to assess the utility of a 
research study for documenting the links between faculty development and student 
learning. 



Background and Origins 

The model for the Partners in Learning (PIL) Program evolved during a decade- 
long collaboration between the late Joseph Katz and Mildred Henry. They developed a 
teaching enhancement program that focuses on student learning while engaging faculty in 
dialogue about the college classroom. Their work has been widely disseminated in the 
volume Turning Professors Into Teachers. 

The structure of PIL is a simple one: faculty pair themselves off and periodically sit 
in on the other’s class over the course of a semester or quarter. During the following 
term, the two switch roles with the observed now doing the observing. The partners meet 
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frequently to discuss their shared experience in the classroom. The partners also interview 
students several times over the course of the term, then meet with other faculty 
participants on campus to discuss their experiences 

The outcomes of participation in PIL are often secondary to the process itself it 
brings attention to the process of student learning, to what students are thinking, and to 
the experiences faculty share. The process rejuvenates instructors, channels the stresses 
that arise from teaching, and mitigates the sense of being isolated in the classroom. 
Through the partnerships, two professors get to share a class and examine together the 
dynamics of student learning in that class. 

Project Description 

Beginning in Academic Year 1992-93, twenty-four faculty at four diverse 
institutions began participation in the project. They were a diverse group; veteran teachers 
who had a strong background in faculty development and teaching enhancement 
initiatives; experienced teachers who had only recently become aware of faculty 
development; those new to college teaching; and others somewhat disinterested in 
teaching enhancement but willing to participate for released time or a stipend. 

The faculty were coupled in interdisciplinary pairs. The faculty member who was 
teaching the course was the “observed,” and the partner was the “observer.” The partners 
alternated roles by semester, and each faculty pair participated in this routine for two of 
the three years. Each member of the pair interviewed at least three students three or four 
times during the semester, and kept journal entries to record their impressions. 

The faculty’s students were surveyed via a pre-test and post-test, examining 
students’ preference for class structure and teaching style; interactions with faculty; 
experiences in the course (principally evaluating the teacher’s behavior); intellectual, 
social, or personal change resulting from the course; teaching behaviors and their impact 
on learning; and progress made in enhancing academic skills in the course. There was an 
academic achievement question with each post-test, designed to reflect students’ mastery 
of the subject matter. The students grade point average and scores on the New Jersey 
Basic Skills Placement Test were collected as well to control for student level. 

The faculty were also observed by NJICTL staff at least three times per semester 
to document clarity, enthusiasm, interaction, organization, pacing, disclosure, and rapport. 
Syllabi from each faculty’s focal course were collected and content analyzed. Meetings 
were held at NJICTL as a forum for participants to discuss their experiences with the 
project and to explore innovative classroom strategies. At the end of Years 1 and 3, 
faculty completed an attitudinal survey about their classroom experiences and feelings 
about PIL. And at the end of the project, each faculty was interviewed by NJICTL staff. 

Evaluation/Project Results 

The faculty surveys show that, over the three years, all or most faculty report that 
they increased the diversity of their teaching strategies, and their willingness to explore 
new ways of teaching; increased their appreciation for faculty influence over students, and 
their role in motivating students; and made actual changes in their teaching methods, most 
particularly the use of active learning strategies. 

The student surveys did not entirely support the faculty’s self-reports of change. 
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The students acknowledged that there were changes in their faculty’s teaching strategies, 
including an increase in the number and quality of interactions with students; and 
an increase in their expectations of students’ academic performance. However, they 
report no significant change in the faculty’s in-class teaching behaviors. Similarly, the 
students report little personal change as a result of their participation in the course, and 
there were no discernible patterns of increased academic achievement (even when 
controlling for ability). 

We asked the faculty about specific changes they had made that were directly 
attributable to the partnering experience. Their responses show that PIL affected their 
professional lives in these ways: 13 of 18 faculty report a positive change in their 
understanding of student learning; 12 of 18 faculty report a positive change in their 
relationships with colleagues; and 11 of 1 8 faculty report a positive change in their 
teaching. 



Summary and Conclusions 

The lessons we learned from this project fall into four general categories: the 
motivation of faculty subjects; monitoring the treatment and data collection; the data -- 
nature, quantity, and sources; and the outcomes assessed. 

A challenge posed to the assessment effort here was how to maintain faculty 
motivation both for participation in the “treatment” and for applying uniform effort in the 
furnishing of data over three and one half years. Despite the number of handouts and 
group meetings, faculty maintained diverse ideas about the various treatments -- their 
purposes and priorities — as well as about their data provision obligations. While the 
number of faculty subjects was small, the amount of data collected from each was massive, 
and the task of analyzing the disparate data sources in a meaningful way was extremely 
difficult. There is also the matter of getting data from the students of faculty subjects, 
especially academic achievement data. Not only are the students not particularly 
motivated to provide such data, but the faculty themselves have major issues on this 
score.. 

When all is said and done, questions remain about the appropriateness of the 
outcomes selected for assessment. In part, the issue is one of the “contextualization” of 
outcomes, i.e., each faculty member comes to this (or any other) faculty development 
experience with their own agendas and the effects are often subtle and rather different 
depending on the individual. When one seeks a few general effects, we fear that you lose 
some of the unanticipated and individualized impacts that are part of the “real” treatment 
effects. This suggests that a good deal more attention needs to be focused on the 
expectations and goals of individual faculty members; and that the assessment effort may 
need to assess the program treatment relative to these individual goals and expectations. 

Appendices 

Student Pre-test Appendix E Syllabi Analysis 

Student Post-test, Year 1 Appendix F Faculty Survey 

Student Post-tests, Years 2/3 Appendix G Exit Interview 

Classroom Observation Protocol 



Appendix A 
Appendix B 
Appendix C 
Appendix D 
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Summary 



The New Jersey Institute for Collegiate Teaching and Learning (NJICTL) assessed 
the impact of the Katz/Henry Faculty Development Model (known as “Partners in 
Learning” or PIL) on the teaching behaviors and student learning outcomes of 24 faculty 
members at four diverse institutions in New Jersey. Data on short term and long term 
learning outcomes, teaching behaviors, and collegial interactions were collected from a 
variety of sources over a three year period. The data showed that participation in PIL 
enhanced faculty’s understanding of student learning, enhanced their relationships with 
colleagues, and caused them to make changes in their classroom teaching. 



Martin Finkelstein 
Director 

New Jersey Institute for Collegiate Teaching and Learning 
Seton Hall University 
South Orange, New Jersey 07079 
(201) 761-9704 



PROJECT OVERVIEW 



The New Jersey Institute for Collegiate Teaching and Learning (NJICTL) assessed 
the impact of the Katz/Henry Faculty Development Model on the teaching behaviors and 
student learning outcomes of 24 faculty members at four diverse institutions in New 
Jersey. The model, known as Partners in Learning (PIL), has been adopted for use 
throughout New Jersey and in at least five other states. This project sought to empirically 
test the impact of PIL on faculty and, most importantly, on student learning. 

Data on short term and long term learning outcomes, teaching behaviors, and 
collegial interactions were collected from a variety of sources over a three year period. 

The data showed that participation in PIL enhanced faculty’s understanding of student 
learning, enhanced their relationships with colleagues, and caused them to make some 
changes in their classroom teaching. Despite these critical self-reported changes, there 
was no discernible pattern of increased student academic achievement in the focal courses 
of the 24 faculty. 



PURPOSE 

As the imperatives for faculty development programming have increased 
dramatically amid severe resource constraints, important questions have surfaced: Does 
participation in these programs have a positive and sustained impact on faculty teaching 
and ultimately on student achievement? Is there a link between faculty development and 
student learning? 

Thus far, there have been few attempts to document program outcomes in terms of 
improvement in teaching or increases in student learning. Evaluations of faculty 
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development programs based on the Katz/Henry model (Rice and Cheldelin, 1989, 1990; 
Cheldelin, 1991) indicate that faculty members report significant improvements in their 
teaching effectiveness; evaluators were, however, unable to verify these self-reports. 

This project afforded an opportunity to assess teaching behaviors from the 
students perspective, the individual faculty’s perspective, and the collective faculty’s 
perspective. It documented the ways in which faculty development efforts can alter 
classroom performance, and in some cases, permanently change the way faculty go about 
teaching their courses. It also provided a framework within which to assess the utility of a 
research study for documenting the links between faculty development, teaching and 
student learning. 

The most challenging aspect of the analysis was determining the best method of 
scrutinizing the myriad data elements in a way that most clearly answered the research 
questions while isolating the effects of the program. This task was complicated by a 
sometimes intractable subject pool: 24 faculty on four diverse campuses over a three-year 
period. At times, the logistical challenges seemed to overwhelm the quasi-experimental 
controls. 

Despite rigorous attempts to maintain a consistent design across the three years, 
several factors beyond our control intruded. Several faculty were awarded a semester 
sabbatical during the project, thus interfering with the alternating pattern of classroom 
observation; one faculty became the director of his institution’s Teaching Excellence 
Center, significantly altering his teaching assignment; one faculty member was forced to 
withdraw near the end of the project because of issues involving litigation between the 
faculty’s bargaining unit and the institution; and illness forced two faculty out of the 
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project for a semester, and caused another to drop out completely (after only one 
semester, and he was replaced by someone who never fully engaged in the project). And 
perhaps the most pertinent and unexpected change centered on the dynamics of the 
partnerships themselves: personality conflicts, scheduling difficulties, and other logistical 
problems caused several of the faculty to "change partners" after only one year of active 
participation. 

While these deviations from the original design complicated the data analysis, they 
reflected the realistic changes in people’s lives over three years. Although fhastrating, they 
added another “human” dimension to this study. 

There were also issues regarding the amount of instruction given the faculty 
participants. The Katz/Henry model stresses the importance of minimal intervention by 
the project coordinator; the faculty partners set their own agenda and agree to their own 
rules for observations, interviews, and the sharing of feedback. While this “hands off” 
strategy supports the nonevaluative norm of the project, it makes even quasi-experimental 
control of the "treatment" difficult to achieve. 



BACKGROUND AND ORIGINS 

Partners in Learning: The Katz/Henry Model . The model for the Partners in 
Learning (PIL) Program evolved during a generation-long collaboration between the late 
Joseph Katz and Mildred Henry. Based on their work vvdth faculty on 12 campuses 
initially supported by one of FIPSE's first grants, Katz developed a teaching enhancement 
program for New Jersey that focuses on student learning while engaging faculty in 
dialogue about the college classroom. The model has been widely disseminated in the 
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volume Turning Professors Into Teachers. 



The stnicture of PIL is a simple one: faculty pair themselves off, preferably with 
someone from a different discipline, and periodically sit in on the other s class over the 
course of a semester or quarter. During the following term, the two switch roles with the 
observed now doing the observing. The partners meet frequently to discuss their shared 
experience in the classroom. Observations are emphatically nonjudgmental and are shared 
only with each other. 

At the start of the semester, each of the partners selects three students and 
interviews them several times over the course of the term. The interviews may follow any 
pattern, but loosely focus on the question: “how do students learn?” 

Once a month, all faculty participants on a campus gather to discuss their 
experiences. And at the end of the semester, each faculty member writes an essay about 
the experience. That essay is shared with participants in preparation for later discussion. 

The outcomes of participating in PIL are often secondary to the process itself it 
brings attention to the process of student learning, to what students are thinking, and to 
the experiences faculty share. The process rejuvenates instructors, channels the stresses 
that arise from teaching, and mitigates the sense of being isolated in the classroom. 
Through the partnerships, two professors get to share a class and examine together the 
dynamics of that class. 

The Katz/Henry model has been unique among faculty development/teaching 
enhancement programs in that 
- it focuses primarily on student learning; 

it is based firmly in the classroom, focusing on the interactions between teacher 
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and student, and among students themselves; 

it is concerned with the ongoing process of teaching and learning rather than 
specific goals or outcomes; and 

it is a grassroots, faculty-run operation encouraging innovation and exploration. 

In the Fall of 1987, Katz was invited to establish a statewide faculty development 
program to disseminate PEL among the public and private institutions in New Jersey. 
Initially supported by the New Jersey Department of Higher Education and administered 
by the Woodrow Wilson National Fellowship Foundation, the program is now part of the 
New Jersey Institute for Collegiate Teaching and Learning (NJICTL). Over nearly a 
decade, PEL programs have operated on 27 campuses in New Jersey alone involving over 
500 faculty. 



PROJECT DESCRIPTIONS 

The Faculty Sample . Beginning in Academic Year 1992-93, twenty-four faculty at 
four diverse institutions began participation in the project. Faculty from Rutgers 
University at Newark (Carnegie Research University I) , Bergen Conimunity College, and 
County College of Morris began in the Fall 1992 semester; faculty from Kean College (a 
public comprehensive) began one semester later, in Spring 1993. 

Table 1 gives a brief description of the faculty, including demographic and 
professional information. Sixteen of the faculty hold doctorates, 6 hold Master’s degrees. 
Ten faculty are full professors, nine are associate professors, and three are assistant 
professors. All but one faculty have received tenure. Their teaching experience averages 
19 years, ranging from six to 40 years. 
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In many ways, the participating faculty were a diverse group: there were veteran 
teachers who had a strong background in faculty development and teaching enhancement 
initiatives (faculty 1 1, 21, 23, 26, and 36); others were experienced teachers who had only 
recently become aware of, and expressed interest in, faculty development (faculty 12, 13, 

3 1, 32, 42, 43); others were relatively new to college teaching and were grappling with 
teaching issues (16, 24, 25, 46); and others seemed to be somewhat disinterested in 
teaching enhancement but willing to participate in the project for the stipend or release 
time it provided (14, 15, 33, 34, 35, 41, 44). 

To give us an understanding at the beginning of the project of who the faculty 
were, we asked two very basic questions: “How did you come to be involved in PIL? 
What do you expect to gain from this experience?” The veteran faculty developers 
suggested this was a natural extension of their involvement in teaching initiatives, a way 
for them to polish their teaching styles using feedback from colleagues at other campuses. 
Others were intrigued with the notion of trying something new, particularly networking 
with other teachers and having collegial discussion on classroom issues. There were those 
who wanted this to be a reality check, to see if their impressions of their teaching were 
validated by other faculty and students. And several faculty report they were persuaded to 
participate by their campus faculty development coordinator. Despite this diversity, 
there seemed to be a relatively high level of enthusiasm, particularly with the prospect of 
the partnering experience and the opportunity to be involved in a federally-funded research 
project. 

Procedures . There were three components of the PIL model that were 
incorporated into the work of every faculty pair: (1) ongoing classroom observations; (2) 



faculty interviews with students; and (3) collegial dissuasions about teaching based on 
observations and interviews. Data pertaining to these three components were collected 
from a variety of sources over the three years of study and were combined to form a large 
database of quantitative and qualitative information. Quantitative data were entered into 
an SPSS+ datafile for manipulation. 

On each of the four campuses, six faculty were engaged in the project (or, three 
faculty pairs). The faculty were coupled in interdisciplinary dyads, typically a social 
scientist and a natural scientist. Deviating slightly from the PIL model, the partnerships 
were “assigned” rather than self-selected in order to adhere to the research design. 

For each of the three academic years, each faculty participant taught a 
“focal”course, here defined as an introductory-level course that was part of their regular 
teaching routine. The faculty member who was teaching the focal course was the 
“observed,” and the partner was the “observer.” The partners alternated roles by 
semester, and each faculty pair participated in this routine for two of the three years. 

These two years were termed “active” years. The third year was termed “fallow,” as 
participation in PIL was not required although data continued to be collected in the focal 
course. 

The twenty-four faculty began the project in two stages -- following the quasi- 
experimental research design. Two of the three pairs on each campus were active in years 
1 and 2, then fallow in year 3. The remaining pair (the control) was fallow in year 1, then 
active in years 2 and 3. Data were collected on the fallow pairs in year 1 to establish a 
baseline control (i.e., “pre-intervention”); data were collected on those fallow in year 3 to 
determine the persistence of change after active participation ceased. Thus, in Year 1, 16 
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faculty were active, 8 were fallow; in Year 2, all 24 faculty were active; and in Year 3, 8 
faculty were active, 16 were fallow. See Table 2 for an illustration of the design of the 
partnering. 

Each member of the pair interviewed at least three students from the focal class 
three or four times during the semester. Holding true to the Katz/Henry model, the 
interviews were directed by the faculty member -- there was little intervention on behalf of 
the research design to control the questions that were asked or the issues discussed. The 
purpose of the interviews was to provide feedback to the focal faculty about the students’ 
learning experience in the course, supplementing the data gathered on the student post-test 
survey. After the interviews, the partners met to discuss the feedback from students, the 
course, and possible teaching strategies. 

To record their impressions of the student interviews and meetings with their 
partner, faculty were asked to make regular entries into a journal. The journals would 
serve as a running account of their participation in the project, and give the faculty the 
opportunity to reflect periodically on their experiences. There were two journal entries 
that were directed by NJICTL, at the beginning and end of the project. 

In each faculty participant’s active years, the students in the focal course were 
surveyed via a pre-test and post-test. The pre-test (Appendix A) was administered early in 
the semester along with a consent form; the post-test (Appendices B and C) was 
administered during the last week or two of classes, and included an academic 
achievement question as designed by the focal faculty. Both surveys began with questions 
seeking demographic data that could be used to allow the introduction of statistical 
controls into the analysis. 



The post-test examined students’ preference for class structure and teaching style; 
interactions with faculty; experiences in the course (principally evaluating the teacher s 
behavior); intellectual, social, or personal change resulting from the course; teaching 
behaviors and their impact on learning; and progress made in enhancing academic skills in 
the course. 

The academic achievement questions pertained to specific material covered in the 
course. They were designed to reflect students’ mastery of the subject matter, and were 
used to compare student group achievement in years 1 and 3, controlling for student 
ability. Three questions were provided; students chose two to answer. 

When the post-tests were collected, the academic achievement question was 
separated from the survey and returned to the faculty for “anonymous” grading. The 
faculty used a nine-point scale to assign grades: A+, A, A-; B+, B, B-; and C+, C, and C-. 
Once the grades were returned, they were incorporated with the post-tests into the student 

database. 

For each student participant, data were collected unobtrusively from each 
institution’s Registrar. To enable some baseline experimental controls, students’ grade 
point average for the semester prior to participation and scores on the New Jersey Basic 
Skills Placement Test were collected. (The state of New Jersey required through 1994 that 
each public high school student complete a Basic Skills Placement Test prior to entering 
college; the scales included in this study were English Comprehension, Algebra, Math 
Computation, and Total Score). 

Each faculty participant was also observed by NJICTL staff at least three times per 
semester teaching their focal course and the observations were recorded according to a 



protocol based on Murray's Teaching Behaviors Inventory [TBI] included in Appendix D. 
Classroom behaviors were recorded according to clarity, enthusiasm, interaction, 
organization, pacing, disclosure, and rapport. At the end of the project, the protocol was 
shared with the faculty to get their impressions and feedback. 

Syllabi from each faculty’s focal course were collected and content analyzed 
employing the protocol in Appendix E. This data element was particularly difficult to 
analyze, given that most of the faculty at community colleges use a departmental syllabus 
that is only a rough outline of topics and readings that follow the text for the course. 

During each of the six semesters of the project, monthly meetings were held at 
NJICTL as a forum for participants to discuss their experiences with the project and to 
explore innovative classroom strategies. For the first semester, all 24 faculty met as a 
group. However, in subsequent semesters, difficulties in scheduling required that the large 
group be broken down into two smaller groups, meeting on successive days. Whereas this 
undermined the cohesiveness of the group, it aided in assuring that the faculty could attend 
at least one of the meeting days. 

The meetings typically included two components: an informal opportunity to raise 
questions or report on project-related experiences in the larger group; and a more 
structured discussion of a reading or case study, usually provided by the NJICTL staff 
leader (but occasionally by the participants themselves in Year 2). Many of the readings 
and cases focused in one way or another on active learning strategies in the classroom. 

At the end of Years 1 and 3, faculty were asked to complete an attitudinal survey 
(see Appendix F). The survey includes many items that in content parallel items on the 
students’ post-tests, including an evaluation of the academic skills required for the course; 
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preferred class structure and teaching style; teaching activities descriptive of the course 
and important for student motivation; faculty influence on student achievement and 
motivation; teaching behaviors that affect student learning; and adaptations and changes in 
the course for subsequent semesters. 

After an initial analysis of the data, it became clear that an exit interview with each 
faculty participant was needed as a frame for interpreting the findings as well as an 
opportunity for participants to achieve closure on their project participation. The protocol 
used is found in Appendix G. 

EVALUATION: PROJECT RESULTS 

In assessing the impact of the PIL model, there seemed to be two questions at the 
heart of the partnering experience: (1) to what extent, and in what ways, do faculty grow 
as teachers? and (2) to what extent, and in what ways, do students grow as learners? And 
further, does this growth (or “change”) persist even after participation in PIL ceases? 
These questions guided the data analysis. 

General Trends . Based on the success of the PIL program in institutions 
throughout New Jersey and overwhelming positive anecdotal information, we had 
hypothesized that there would be significant changes in the faculty’s teaching methods, 
their perceptions of and attitudes toward students, and their personal and professional 
relationships with colleagues. The data provide partial support for these hypotheses. 

The faculty surveys show that, over the three years, all or most faculty report that 

they 

increased the diversity of their teaching behaviors and strategies, and their 
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willingness to explore new ways of teaching [Table 3]; 

- increased their appreciation for faculty influence over students, and their role in 
motivating students [Table 4]; and 

made actual changes in their teaching methods, most particularly the use of active 
learning strategies [Table 3], 

The student surveys did not entirely support the faculty’s self-reports of change. 
The students acknowledged that there were changes in the faculty’s classroom behavior 
regarding 

an increase in the number and quality of interactions with students [Table 5]; and 
an increase in their expectations of students’ academic performance [Table 4], 
However, the students report little personal change as a result of their participation in the 
course [Table 6], and there were no discernible patterns of increased academic 
achievement, even when controlling for ability [Table 7], 

The last item on the faculty survey was an open-ended question about specific 
course changes the faculty had made that were directly attributable to the partnering 
experience. Their responses show that PIL impacted their teaching as follows: 

13 of 18 faculty report a positive change in their understanding of student learning; 
12 of 18 faculty report a positive change in their relationships with colleagues; and 
11 of 18 faculty report a positive change in their teaching. 

We investigated further to see if we could detect any distinguishable patterns 
among faculty based on some demographic, personality or other characteristic. No single 
such pattern clearly emerged from the data. Reflecting back on the Katz/Henry model, we 
were able to identify two factors that appeared to distinguish impressionistically among 
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faculty: perceived degree of change in teaching/classroom behavior and amount of 
personal reflection about the change process. Using these two factors, we attempted to 
determine how (and if) our faculty could be categorized into “types” based on our 
knowledge of them and the data we collected that reflected the patterns of change we 
observed. 

Using our informal interactions with faculty, their journals, and the exit interviews, 
we plotted each faculty participant on a 2x2 change/reflection grid (see Table 8). Three 
clusters emerged; (1) those at the low end of the change and reflection scale, who we 
labeled “resisters”; (2) those in the middle of the grid, comprising the largest number of 
faculty, labeled “moderate changers”; and (3) those on the upper end of the scales, labeled 
“converts.” As expected, there were anomalies who did not fit precisely into either 
category, but these clusters seemed to be a meaningful way to look at the faculty 
participants. 

We then used the students’ and faculty self-reports to test our change/refiection 
designations. We found that our typology was not on the whole supported. Most of the 
changes that occurred across the three years of the project seem to follow no real pattern. 
Distinguishing between faculty types based on the students’ responses or the faculty self- 
reports was, with few exceptions, impossible. However, it is informative to look at two 
groups of faculty that distinguished themselves from the rest: those at the high end of the 
change/refiection continuum, and those at the opposite end. 

There were four faculty (36, 13,31, and 46) who appeared to exhibit the greatest 
professional growth — the greatest changes -- over the three year period. They 
distinguished themselves from the rest of the faculty in their willingness to reflect on their 
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own teaching, to consider their students’ learning styles, and consequently, to make 
changes in their teaching strategies. They moved clearly from “teacher-oriented” to 
“learner-oriented” and the prospects for continued reflective change appear very high. 

Of these converts, faculty 36 was the “big winner” for the project. Consistently, 
he reported the greatest changes in his classroom, and the students reinforced that notion. 
He was one of the most dedicated participants in the project, was very reflective about his 
teaching, and most concerned about the quality of his students’ learning experience. He is 
actively involved in both teaching and research, and has taken part in other faculty 
development initiatives before (and since) PIL at his research university. 

At the other end of the change/reflection continuum were faculty that we would 
describe as resistant, exhibiting very little change from their year 1 starting point. These 
faculty (15, 34, 41, 44) were, in most ways, out of sync with the rest of the faculty 
participants. They viewed the issues raised in the project as not pertinent to their 
classrooms and to their style of teaching. At times antagonistic, but principally distant and 
removed, these faculty did not avail themselves of the interaction and dialogue that 
characterized other partnerships. 

Faculty 15 exemplifies the “resisters”. He was a “negative” presence in the project 
— with his partners and with his colleagues at NJICTL meetings. The students rated him 
low on most scales, and there were almost no positive changes on any variables over the 
three years. He writes in his journal that he lost interest in the project after year 1, and 
considering that he was fallow that year, all the momentum he had for his partnerships was 
lost. 

There were two faculty that fall into the “anomaly” category. Faculty 25 seemed. 
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based on our interactions and observations, to be a moderate changer who was cautiously 
open to new ideas. She had a stable three-year partnership that was very valuable to her 
development as a teacher. But her student ratings showed a negative trend across the 
three years on almost every item. Whereas we anticipated that there would be instances of 
resistance and conversion, and further that there would be evidence of "disruption" ( a dip 
in student satisfaction as old ways gave way to the new) over the three year period, we 
were confounded by the consistent indicators of declining student satisfaction. 

We initially labeled Faculty 41 as resistant because of the way in which he stayed at 
the outer fringes of the project. He was cynical about teaching and the impact he had on 
students. He had difficulty with his partners to the extent that they canceled observations 
and meetings, and the exchange of feedback was minimal to nonexistent. To our surprise 
were his student scores; consistently, he scored positive changes over the three years. 
Looking at the student scores alone, he should be considered one of the biggest converts 
in the project. However, looking simultaneously at both the quantitative and qualitative 
data for him provides us with two very different stories. 

Several of the faculty experienced an appreciable positive change from year 1 to 
year 2, then a considerable decline from year 2 to year 3. This trend is particularly evident 
in Faculty 46. Perhaps this can be attributed to the three year study period; there were 
reports that sustaining interest over six semesters was a difficult task, and enthusiasm 
waned as the project progressed. 

The largest group of faculty were those we characterized as “moderate changers.” 
These were faculty who, based on personal and professional characteristics, were most 
representative of the “typical” faculty — those falling in the middle of the bell curve. This 
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group was the most difficult to plot with any precision on the change/reflection grid 
because there were such subtle differences among them. 

SUMMARY AND CONCLUSION 

The portrait that emerges from our analysis is one of muddied, but perceptibly 
positive, impact — largely along the lines that are predictable from the Katz/Henry model. 
Faculty participants, on the whole, became more learner-centered (understood their 
students better and got them more involved in the learning process), more collegial in their 
teaching work , although neither of these developments appeared to directly translate into 
measurable student achievement gains. We cannot help but speculate about what 
magnitude of effects might have been discernible had we been able to select a random or 
at least broadly representative group of faculty for "treatment" as well as a matched 
control group. Our participants were, after all, largely a self-selected group of faculty who 
started out with an interest in, and a willingness to invest energy in, their teaching. Many 
were already well along in their growth trajectory and so were, in many respects, likely to 
show relatively less dramatic growth and development. We had, in a sense, by our design, 
stacked the deck against identifying any substantial program impact. 

Understanding these limitations as given, we have in the course of this three and 
one half year assessment effort, nonetheless learned a good bit about the other limitations 
as well as the strengths of the various elements of our “eclectic” evaluation approach. 
Reflecting on these, we can identify a series of lessons that FIPSE would do well to share 
with other project directors. The lessons fall into four general categories: the motivation 
of faculty subjects; monitoring the treatment and data collection; the data — nature. 



quantity, and sources; and the outcomes which we address in turn below. 



Faculty Motivation . The faculty participants in this project began as a highly 
motivated group. They were after all volunteers engaging in a new, and much heralded, 
program with the blessings of their campus’ chief academic officer. The challenge posed 
to the assessment effbrt here was how to maintain faculty motivation both for 
participation in the “treatment” (the PIL regimen of the classroom observation, student 
interviewing and colleague debriefing) and for applying uniform effbrt in the furnishing of 
data over three and one half years. In part, the difficulty was posed by the experimental 
design itself, requiring one third of the group to be “fallow” in the first year (the 
motivational challenges faced by this subgroup were distinctive). In larger part, the 
challenge was simply one of sustaining interest and effbrt over a very long time. We 
noticed a clear drop-off in attendance at the monthly project meetings and declines both in 
the number and length of journal entries. 

An assessment project such as this requires thinking through very carefully a 
multistage plan for faculty motivation that recognizes both the dampening effects of a 
quasi-experimental design and that explicitly addresses the “natural” dampening effect of 
time and familiarity. 

Monitoring the Treatment and Data Collection . One of the things we learned most 
clearly from the exit interviews was that participants, despite the number of handouts and 
number of group meetings, maintained diverse ideas about the treatment — its purposes 
and priorities — as well as about their data provision obligations. It was not, as we 
learned, merely a matter of stating and restating requirements verbally and in writing; 
rather, we needed to “monitor” periodically how the treatment was going and the quality 
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and extent of the data being provided. In particular, a project such as this should during 
the first year (especially the first semester) check in with each faculty member on an 
individual basis to determine how the treatment is proceeding as well as provide that 
faculty member with feedback on the quality of data they were providing. These 
individual interviews would have provided an ideal opportunity to test participant 
understanding of the project, the treatment, and their role. We depended on the faculty 
development coordinators at each campus to do that and their work was quite uneven. In 
sum, the exit interviews (which were not part of the original proposal, but which we 
realized needed to be done for the participants) should have occurred at least annually and 
been integrated into the project from the very beginning. 

The Nature. Quantity, and Sources of Data . While the number of faculty subjects 
was small, the amount of data collected from each was massive. There was so much data 
and, quite candidly, insufficient attention paid in advance to how that data would be 
analyzed. In particular, insufficient prior thought had been given to the relationship 
between the qualitative data elements and the quantitative data elements. When the 
portrait that emerged from the two separate streams of data diverged, there was no basis 
for connecting qualitative and quantitative items, and allowing them to mutually inform 
each other. 

Finally there is the matter of getting data from the students of faculty subjects, 
especially academic achievement data. This constituted the single most troublesome part 
of the project. Not only are the students not particularly motivated to provide such data 
(and addressing the student motivation issue is something that future projects need to do), 
but the faculty themselves have major issues on this score. Most faculty (1) do not want 
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to take any extra time from their course to have students provide data that is not part of 
the course; and (2) are troubled by the ethics of asking students to take on something that 
is not strictly speaking part of the course (despite the student consent form we used). The 
major challenge we faced was dealing with faculty on this issue. We succeeded in only a 
limited fashion; and this deserves much further attention from those who want to 
undertake serious assessment of the impact of faculty development programming. 

The Outcomes Assessed . When all is said and done, the questions remain about 
the appropriateness of the outcomes selected for assessment. In part, the issue is one of 
the “contextualization” of outcomes, i.e., each faculty member comes to this (or any 
other) faculty development experience with their own predispositions and the effects are 
often subtle and rather different depending on individual agendas. When one seeks a few 
general effects, we fear that you lose some of the unanticipated and individualized impacts 
that are part of the “real” treatment effects. This suggests that a good deal more attention 
needs to be focused on the expectations and goals of individual faculty members; and that 

the assessment effort may need to asses the program treatment relative to these individual 

0 

goals and expectations. 
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Table 1. Demographic and Professional Data 



Faculty 

it 


Institution 


Discipline 


Rank 


Highest 

Degree 


Degree 

Granting 

Institution 


Years in 
College 
Teaching 


Tenured 

Y/N 


11 


Bergen 


Sociology 


Prof 


PhD 


NYU 


24 


Y 


12 


Bergen 


Horticulture 


Prof 


PhD 


Maryland 


■ 27 


Y 


13 


Bergen 


Science 


Assoc 


PhD 


NYU 


27 


Y 


15 


Bergen 


Math 


Assoc 


EdD 


Rutgers 


27 


Y 


16 


Bergen 


Sociology 


Prof 


PhD 


Rutgers 


16 


Y 


21 


Morris 


Psychology 


Assoc 


MA 


Temple 


23 


Y 


23 


Morris 


Sociology 


Prof 


PhD 


NYU 


27 


Y 


24 


Morris 


ChemBio 


Asst 


MS 


Fairleigh D. 


7 


Y 


25 


Morris 


Math 


Assoc 


MA 


Montclair 


10 


Y 


26 


Morris 


Sociology 


Prof 


MA 


Adelphi 


26 


Y 


31 


Rutgers 


Math 


Assoc 


PhD 


Illinois 


8 


Y 


32 


Rutgers 


Psychiatry 


Prof 


PhD 


Columbia 


7 


Y 


33 


Rutgers 


Psychology 


Assoc 


PhD 


Rutgers 


6 


Y 


34 


Rutgers 


Sociology 


Assoc 


PhD 


Wisconsin 


12 


Y 


35 


Rutgers 


Poll Sci 


Prof 


PhD 


Colorado 


19 


Y 


36 


Rutgers 


Biology 


Prof 


PhD 


Cornell 


20 


Y 


41 


Kean 


History 


Prof 


PhD 


Columbia 


26 


Y 


42 


Kean 


Math 


Assoc 


PhD 


Yeshiva 


21 


Y 


43 


Kean 


Chemistry 


Prof 


PhD 


SUNY 


17 


Y 


44 


Kean 


Biology 


Assoc 


MA 


Columbia 


40 


Y 


45 


Kean 


Math 


Asst 


MA 


Kean 


28 


Y 


46 


Kean 


Biology 


Asst 


PhD 


Colorado 


6 


N 



Data were not provided for Faculty 14 
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Table 2. Partnering: Demographics and Schedule of Participaiiun 



Year 1 

Instructor Discinline 


Gendej- 


Y££JL1 

Instructor Discipline 


Gender 


Year 3 

Instructor Discipline 


Gender 


11 sociologist 


male 


11 sociologist 


male 


11 sociologist 


male 


12 horticulturist 


male 


12 horticulturist 


male 


12 horticulturist 


male 


13 biobgist 


female 


13 biologist. 


female 


13 biologist 


female 


14 mathematician 


male 


15 statistician 


male 


14 mathematician 


male 


15 statistician 


male 


14 mathematician 


male 


15 statistician 


male 


16 sociologist 


male 


16 sociologist 


male 


16 sociologist 


male 


21 psychologist 


female 


21 psychologist 


female 


21 psychologist 


female 


22*bioIo^st 


male 


27 mathematician 


female 


27 mathematician 


female 


23 sociologist 


male 


23 sociologist 


male 


23 sociologist 


male 


24 biologist 


female 


24 biologist 


female 


24 biologist 


female 


25 mathematician 


female 


25 mathematician 


female 


25 mathematician 


female 


26 sociologist 


male 


26 sociologist 


male 


26 sociologist 


male 


31 mathematician 


male 


3 1 mathematician 


male 


31 mathematician 


male 


32 psychologist 


male 


32 psychologist 


male 


32 psychologist 


male 


33 psychologist 




33 psychologist 


male 


33 psychologist 


male 


34 sociologist 


|||:miSe||^ 


34 sociologist 


male 


34 sociologist 


male 


35 political scientist 


male 


35 political scientist 


male 


35 political scientist 


male 


36 bioloeist 


male 


36 biologist 


male 


36 biologist 


male 


41 historian 


male 


4 1 . historian 


male 


41 historian 


male 


42 mathematician 


female 


44 biologist 


male 


44 biologist 


male 


43 chemist 


male 


42 mathematician 


female 


42 mathematician 


female 


44 biologist. 


male 


46 biologist 


female 


43 chemist 


male 


45 mathematician 


female 


43 chemist 


male 


45 mathematician 


female 


46 biolosist 


female 


45 mathematician 


female 


46 biologist 


female 



* Instructor 22 dropped out of the project after the first semester because of health reasons; replaced by Instructor 27 
Shadinjg indicates ACTIVE participation . 
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Table 3. Faculty Survey: Changes in Course Due to PIL 








+: positive response for years 1 , 2, or 3 
no symbol: no response for years 1, 2, or 3 
n/a: no data available 



Table 4. Faculty Survey: Changes from Year 1 to 3 By Variable 
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Table 6. Student Survey: Ways Students Have Changed Because of This Class 
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Table 7. Student Survey: Academic Achievement Scores By Faculty 



Faculty 


Academic Achiev( 
Mean Scon 
Year 1 Year 3 


sment 

Difference 


F 


Significance 


11 


7.160 


7.429 


0.269 


1.744 


0.1844 


12 


5.692 


6.667 


0.974 


0.223 


0.6442 


13 


8.046 


6.750 




5.924 


0.0195 


14 


5.083 


7.400 


2.317 


2.366 


0.1445 


16 


7.941 


6.421 


-1.520 


iiiliiliw 


0.0241: 


21 


7.308 


8.500 


1.192 


1.828 


0.1941 


23 


7.250 


6.643 


-0.607 


0.575 


0.4558 


24 


5.357 


4.000 


-1.357 


1.628 


0.2166 


25 


5.000 


7.588 


2.588 


7.450 


0.0015 


26 


. 7.870 


5.500 


-2.370 


15.239 


0.0003 


33 


. . 6.000 


7.076 


1.076 


7.992 


0.0056 


36 


6.406 


5.091 


-1.315 


4.184 


0.0176 


41 


3.200 


... 4.769 


i;569 


4.179 


0.0512 



Shading indicates a significance level of less than .OS 

Mean Scores Grading Scale: 1=A+; 2=A; ... 9=C-. Missing data and 

incomplete responses were not included. 
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Appendix A 
Student Pre-Test 



PARTNERS IN LEARNING RESEARCH PROJECT 
STUDENT INFORMED CONSENT FORM 

Your college is participating in a research project designed to 
assess the impact of the "Partners in Learning” ("PIL”) program 
on teaching and learning. The ”PIL” program is designed to 
improve teaching and learning in higher education by bringing 
faculty members together as partners to work on their teaching. 

The research project, sponsored by the U.S. Department of 
Education’s Fund for the Improvement of Postsecondary Education 
(FIPSE) is being conducted by the New Jersey Institute for 
Collegiate Teaching and Learning (NJICTL) which is housed at 
Seton Hall University. A critical aspect of this research 
project is understanding students* experiences in the classroom. 

Your institution has authorized us to contact you to solicit your 
participation in this project. Your privacy as a study 
participant will be fully respected. While members of the 
immediate research team will collect information from you 
regarding your experiences in this class and your educational 
goals, your responses will remain confidential and your name will 
not be associated with the results in any way. 

As part of this research project we ask that you respond to a 
brief survey instrument, given during class time, at the 
beginning and end of the term. Completion of the two instruments 
will take at least an hour but no more than two hours. We also 
request access to your registrar's data (NJ Basic Skills test 
scores and college grade point average). For most of you, 
participation in this project will end at the end of this term. 

A few of you, however, will be contacted regarding longer-term 
participation . 

We expect that you will find your involvement in this research 
project interesting and beneficial. Nevertheless, we want to 
emphasize that you may refuse to answer any questions or decline 
the use of data without penalty of any kind. You are free to 
withdraw your consent and to discontinue participation at any 
time, without prejudice. If you have any questions or comments 
regarding specific aspects of the research project, please feel 
free to contact Dr. Martin Finkelstein, Director of NJICTL, at 
(201) 761-9704. If you are interested in your institution's 
participation, contact your Academic Dean. 

********************** 

This project has been reviewed and approved by the Seton Hall 
University Institutional Review Board for Human Subjects 
Research. The IRB believes that the research procedures 
adequately safeguard the subject's privacy, welfare, civil 
liberties, and rights. The Chairperson of the IRB may be reached 
through the Office of Grants and Research Services. The 
telephone number of the office is (201) 378-9806. 

I have read the material above, and any questions I asked have 
been answered to my satisfaction. I agree to participate in this 
activity and authorize the research team to attain appropriate 
data from the registrar, realizing that I may withdraw without 
prejudice at any time. 



Print Name 



Date 
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(Signature! 



PARTNERS IN I .EARNING: THE STUDFNTS EXPERIENCE 



Inslriiclions: 



Unless otherwise in<lualc«l, please mark an “X- next to the 
answer yon elunrse. 



nACKGROl'NO AND rOl.UEGF GOALS 

1 . What is your sex? 

l-einale 

Male 

2. Ape on your last birtlnlay? 

3. Yotir Raeial/F.thnic Mentifiration? 

African Amcrican/Hlark 

Asian Amcrican/Oriental 

C‘al 1 casian/^^’hite (Non-1 lispanir) 

l^atino(a)/!lispanie 

Native American 

^Otl’.ei 

4. C iti 7 cnsliip Stains; 

U.S. 

Olhei 

5. What is the highest level of formal etiiiration your 
parents have? (Mark one in each rolnmn) 

Mother Father 

Grammar School r»r less 

Some High School 

High School Graduate 

Some College 

College I>egree 

|’(»St-Gra<liiale Depiee 

6. What is your current enrollment status at this 
college /university? 

Full Time Student 

I’arl- Time Slmlent 

7. wtiy still enter this collc&c ? (Tlcasc mark only one.) 

No definite reason in mind 
To take a few job-related courses 
lo take courses necessary f<H transferring to 
another college 

To obtain or maintain a certification 
To complete a vot;ational/lechnical program 
1t> obtain an Ass<»ciate Degree 
To obtain a Bachelor s Degree 



8. What is the highest academic degree that you ctirrently 
plan lo gel? 

None 

Associate Degree (A.A. or equivalent) 

Bachelor's Degree (D.S., B.A., etc.) 

Master’s Degree (M.A., M.S., etc.) 

Doctoral Degree (Ph D. or Fxl.D.) 

Medical Degree (M.D., D.D.S., or D.V.M.) 

Law Degree (LL.B. or J.D.) 

Other (describe): 

9. How sure arc you that you will gel an undergraduate 
degree? 

Completely sure ! will gel my degree from this 

institution 

Completely sure I will get my degree, but not 

necessarily from this institution 

Not completely sure I will gel my degree 

10. Do you plan to enroll at this institution next semester? 

Yes 

No 

Not sure 

11. W'hat is your current cla.ss standing? 

Freshman 

Sophomore 

Junior 

Senior 

Other: 

12. What is/are the major rea.son(s) you took t^coursc? 
(mark all that apply) 

My advisor suggested it 

It is required for my major 

It fulfills a general education requirement 
It sounded interesting 
It was the only class available 
It is a free elective 



S,u..c„,s h,v. differen. .Acs schen i, co„,cs .o Css s.n,c.ure and teaching sty^. I:": 

or if yon like them b.»ih the same amount, you would place an "X" in the middle. 



A. F-«ay icsts 

B. Re(|iiiicd Attemlancc for class 



True-false or multiple choice tests 
Attendance not required 



('. Doing a project with several : 

others in the class 

n. I'tofessors who leave it up to : 

yrm to keep up with 
your wmk 

F.. A class that piesents a clear : 

I mint «>f view 

F V d 'ss tlia: s your : 

indciKndencc even though 

ihv issignmcnf*: nriy be vague and 

y!!‘ unvurv of whu's evpcricd 



Doing a project by yourself 



Professors who often check up on 

you to make sure that your 

work is being done properly and nn lime 

A class that presents different points 
of view and leaves it up to you to 
develop your own point of view 

A class that stresses clear requirements 
even though it may restrict your 
independence 



G. 



Ixcturc classes 



Discussion classes 



Appendix B 
Student Post-Test 
Year 1 



Instructions: 



Unless otherwise indicated, please mark an next to the 
answer you choose. 

PART I. BACKGROUND AND COLLEGE GOALS 

1. What is your sex? 

Female 

Male 

2. Age on your last birthday? 

3. Your Racial/Ethnic Identification? 

A frican American/Black 

Asian American/Oriental 

Caucasian/White (Non-Hispanic) 

Latino(a)/Hispanic 

Native American 

Other 

4. Citizenship Status: 

U.S. 

Other 

5. What is the highest level of formal education your 
parents have? (Mark one in each column) 

Mother Father 

Grammar School or less 

Some High School 

High School Graduate 

Some College 

College Degree 

Post-Graduate Degree 

6. What is your current enrollment status at this 
college/university? 

Full-Time Student 

Part-Time Student 



7. Why did you enter this college ? (Please mark only one.) 

No definite reason in mind 

To take a few job-related courses 

To take courses necessary for transferring to 

another college 

To obtain or maintain a certification 
To complete a vocational/technical program 
To obtain an Associate Degree 
To obtain a Bachelor’s Degree 

8. What is the highest academic degree that you currently 
plan to get? 

None 

Associate Degree (AA. or equivalent) 

Bachelor’s Degree (B.S., BA., etc.) 

Master’s Degree (M.A., M.S., etc.) 

Doctoral Degree (Ph.D. or Ed.D.) 

Medical Degree (M.D., D.D.S., or D.V.M.) 

Law Degree (LL.B. or J.D.) 

Other (describe): 

9. How sure are you that you will get an undergraduate 
degree? 

Completely sure I will get my degree from this 

institution 

Completely sure I will get my degree, but not 
necessarily from this institution 

Not completely sure I will get my degree 

10. Do you plan to enroll at this institution next semester? 

Yes 

No 

Not sure 



11 . Students have different likes when it comes to class structure and teaching style. Please look over the two phrases at each letter 
below and mark an ”X" in the scale closest to the end most like your choice. For example, in item A if you like essay tests much more 
than multiple choice tests, you would place an "X" on the far left side; if you don’t like one phrase more than the other or if you like them 
both the same amount, you would place an ”X" in the middle. 

A. Essay tests : : : : : : True-false or multiple choice tests 

B. Required Attendance for class : : : : : : Attendance not required 



C. Doing a proiect with several 
others in the class 


Doin£ a proiect by yourself 


D. Professors who leave it up to 
you to keep up with 
your work 


Professors who often check up on 

you to make sure that your 

work is being done properly and on time 


E. A class that presents a clear 
point of view 


; : : A class that presents different points 

of view and leaves it up to you to 
develop your own point of view 


F. A class that stresses vour 
independence even though 
the assignments may be vague and 
you are unsure of what’s expected 


: : : A class that stresses clear requirements 

even though it may restrict your 
independence 


G. Lecture classes 


Discussion classes 



PART II. EXPERIENCES IN THIS COURSE 



12. Listed below are various sentences about this 
course and its instructor . Please show the extent to which 
you agree or disagree with each by circling the number that best 
fits your answer. 1 = strong disagreement and 5 = strong 
agreement. 



Agree Strongly 

Agree 

Neither Agree Nor Disagree- 

Disagree 

Disagree Strongly 



A. The presentation of material in this 
course is well organized. 

B. The instructor keeps students informed 
of their progress. 

C. I am developing more confidence in 
myself because of this class. 

D. The instructor checks to see if students 
understand before going on to new things. 

E. I feel I am not performing up to my 
potential in this course. 

F. The instructor often points out practical 
applications and concepts. 

G. Students in this course are free to 
disagree and ask questions. 

H. This course requires my best intellectual 
effort. 

I. The instructor gives individual attention 
to students in the class. 

J. The instructor asks for more than students 
can get done. 

K. I like this subject more because of taking 
this class. 

L. Through this course I am learning to 
know the main points and central issues in 
this field. 

M. The instructor is not willing to meet 
and help students outside class. 

N. I have a strong desire to take this course. 

O. I am gaining a better understanding of 
myself through this course. 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 



Strongly Agree 

Agree 

Neither Agree Nor Disagree 

Disagree 

Strongly Disagree 1 

P. The instructor criticizes students when 1 2 3 4 5 
they make errors. 

Q. The instructor is well prepared for each 1 2 3 4 5 
class. 

R. The instructor is receptive to discussion 1 2 3 4 5 
outside class. 

S. The instructor maintains good feeling in 1 2 3 4 5 
the class. 

T. The instructor motivates me to do my 1 2 3 4 5 

best work. 

U. The instructor relates course material to 1 2 3 4 5 
real life situations. 

V. The instructor does not use class time 1 2 3 4 5 

efficiently. 

W. The instructor answers student questions 1 2 3 4 5 
in a way that helps students. 

X. Through this course I am learning to value 1 2 3 4 5 
my viewpoints. 

Y. The instructor isn't sensitive to student 1 2 3 4 5 

difficulty with course work. 

Z. Through this course I am gaining a good 1 2 3 4 5 
understanding of concepts/principles in 

this field. 

AA. The instructor treats students with 1 2 3 4 5 

respect. 

BB. The instructor assigns a reasonable 1 2 3 4 5 

amount of work to the class. 

CC. The instructor uses students' questions 1 2 3 4 5 

and ideas in the lecture. 

DD. The instructor doesn't stimulate my 1 2 3 4 5 
intellectual curiosity. 

EE. The instructor has teacher-student 1 2 3 4 5 

discussions as opposed to just question- 
answer sessions. 

FF. I am increasing my awareness of my own 1 2 3 4 5 

interests and talents through this course. 

GG. The instructor makes good use of 1 2 3 4 5 

examples and illustrations to get across 
difficult points. 
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Agree Strongly 

Agree 

Neither Agree Nor Disagree 

Disagree 

Disagree Strongly 

HH; The instructor praises students for 12 3 4 

good ideas. 

II. I am interested in doing outside reading 12 3 4 
about the course material. 

JJ. The instructor acknowledges all questions 12 3 4 
when possible. 

KK. The instructor's explanations are unclear. 12 3 4 

LL. I am learning to apply principles from 12 3 4 
this course to new situations. 

MM. The instructor suggests specific ways 12 3 4 
students can improve. 

NN. The instructor presents challenging, 12 3 4 
thought-provoking ideas. 

OO. The instructor shows a genuine concern 12 3 4 



for students. 

PP. Course requirements are clear. 12 3 4 

QQ. The instructor is confused by un- 12 3 4 

expected questions. 

RR. I am becoming more interested in the 12 3 4 
subject matter of this course. 

SS. The instructor encourages students to 12 3 4 
ask questions or make comments. 

TT. The instructor uses concrete, everyday 12 3 4 
examples to explain concepts and principles. 

UU. The instructor doesn't really listen to 12 3 4 
what students have to say. 

W. I am stimulated to discuss related 12 3 4 

topics outside of class. 

WW. The instructor knew when students 12 3 4 
didn't understand a particular point. 

XX. I feel free to ask questions or express 12 3 4 



my opinions. 

YY. The instructor often fails to define new 12 3 4 
or unfamiliar terms. 

ZZ. The instructor encourages student 12 3 4 

comments even when they turn out to be 
incorrect or irrelevant. 




13. What is/are the major reason(s) you look this course? 
(choose one) 

My advisor suggested it 

It is required for my major 

It fulfills a general education requirement 

It sounded interesting 

It was the only class available 

It is a free elective 

14. Were you interviewed during this semester, by your 
instructor or by another faculty member about your 
experiences, for the "Partners in Learning" Program? 

Yes No 



15. We are interested in how you relate to faculty on this 
campus. How often have you done each of the following 
with the faculty member teaching this course since the 
beginning of the semester? 

Three Times 

or More r 

Twice 



A. Socialized informally 0 12 3 

B. Discussed your career plans and 0 12 3 

opportunities 

C. Discussed a personal problem 0 12 3 

D. Discussed academic issues outside 0 12 3 

of class 

E. Discussed and received helpful 0 12 3 

feedback on your tests, assignments, and/or 
academic work 



16. Please list up to three ways in which you have changed 
because of this class (e.g. developed new skills, changed world 
view, are less interested in the subject, behave differently, etc.). 
(If there is none, say so). 



I 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 
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17. Listed below are some statements teachers have used to describe the most important things they do to assist student learning. Please 
circle the appropriate number in the first column to show the extent to which the instructor of thK course did these things, and in column 
2, circle the number which shows how helpful you think the action is in helping you learn. 

The instructor As a way to help me 

did this: learn, this is: 



Very Often* 

Often 

Sometimes — 

Rarely 

Never 



A. Encourages student criticism of instructor’s ideas 

B. Provides extra help sessions 

C Encourages students to discuss ideas that go beyond class 
readings 

D. Provides structure to clarify the course material 



Very Helpfiil- 
Helpfiil- 



1 . 

I Somewhat Helpfiil- 
Not Helpful 



Not At All Helpful* 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 



1 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



E. Finds ways to motivate or interest student 



1 2 3 4 5 



1 2 3 4 5 



F. Shows enthusiasm for the subject 1 2 3 4 5 

G. Relies primarily on classroom discussion as a teaching 1 2 3 4 5 

technique 

H. Shows personal concern and empathy for students 1 2 3 4 5 

I. Tries to provide a role model for students 1 2 3 4 5 

J. Frequently departs from prepared materials during 1 2 3 4 5 

class to pursue questions or comments from students 



1 2 3 4 5 

1 2 3 4 5 

12 3 4 
1 2 3 4 5 

1 2 3 4 5 



18. To what extent do you feel each of the following (1) Describes this instructor, and (2) is important to vour interest/motivation in a 
class? 1 = not at all; 10 = a great deal. 



Descriptive of 
This Instructor 



Important to Your 
Interest/Motivation 



A. Stimulate student interest 1...2...3...4...5...6...7...8...9...10 1...2..3...4...5...6...7...8...9...10 

B. Present material 1...2..3...4...5...6...7...8...9...10 1...2...3...4...5...6...7...8...9...10 

enthusiastically 

C Meet course objectives 1..3...3...4...5...6...7...8...9...10 1...2..3...4..3...6...7...8...9...10 

D. Be respectful of students 1..3..3...4..3...6...7..3...9...10 1..3..3...4..3...6...7...8...9...10 

E. Motivate students to 1...2...3...4..3...6...7...8...9...10 1..3..3...4...5...6...7..3...9...10 

attain high standards 

F. Be prepared and 1...2..3...4..3...6...7...8...9...10 1..3..3...4..3...6...7...8...9...10 

organized 

G. Be intellectually 1...2..3...4..3...6...7...8...9...10 1..3..3...4..3...6...7..3...9...10 

challenging 
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19. Listed below are a variety of academic ski\\% and talents that can be improved or strengthened through particular classes. Please 
circle the number which best matches (1) the amount of progress you feel you have made in each of these areas as a result of tlm course, 
and (2) how important this skill is to you and your goals for college. 

Amount of Progress Importance of 

You've Achieved Skill to You 

as a Result of This Course 



Much ProgT( 
Some ProgT( 

Little Progress — 
No Progr< 



jess — I 



A. Factual knowledge : acquiring new terms, 12 3 4 

methods, or information 

B. Skills Traininfi : learning specific tasks or 12 3 4 

professional skills 

C. Principles : learning new theories, generalizations, 12 3 4 

and ways of organizing information 

D. Application : learning how to use new information, 12 3 4 

concepts, and methods to solve current problems 

E. Creativity: developing creative capacities -- learning 12 3 4 



to be more expressive or learning how to approach and 
solve problems in a new way 



F. Appreciation : gaining greater sensitivity to specific 12 3 4 

intellectual, scientific, or artistic endeavors 



G. Self-Understanding : acquiring a better sense of myself 12 3 4 
and/or relationships with others 

H. Self-Management : learning how to plan more effectively 12 3 4 
for and/or control personal, academic, and/or 

professional life 

I. Critical Thinking : improving my rational thinking, 12 3 4 

problem solving, and decision making capacity 

J. Communication : developing skill in expressing myself 12 3 4 
orally or in writing 



Very Important- 



Somewhat Important 

Not Very Important 
Not At All Important 



1 



12 3 4 
12 3 4 
12 3 4 
12 3 4 
12 3 4 

12 3 4 
12 3 4 
12 3 4 

12 3 4 
12 3 4 
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Appendix C 
Student Post-Test 
Years 2 and 3 



Name: 



^eiae Prim Legibly) 



Thii infonmtioa U requMcd for record-kecpinf puipowt only, ft will rcimia coiuidcntitl-neitber your name nor tny other idenlilyiag chanctehitic will 
ever be auocuted with your rtipofiaea. 

THIS PACE WILL BE TORN OFF THE SURVEY ONCE COLLECTED TO ASSURE CONFIDENTIALITY. 






49 



Instnictio^ 



Unless otherwise indiceied* plesse mirk sn *X* next to the snswer you 
choose. 

Parti. Background and colleob goals 

1 . Whet is your sex? 

Femtle 
^Mile 

2. Age on your Ust birthdiy? 

3. Your Recisl/EUinic Identificsiion? 

African Americen/Black 

Asian Ameiican/Orienul 
C aucasian/White (Non-Hispanic) 

Latino(a)/Hispanic 

Native American 

Other 



4. Do you plan to enroll at thia institution next semesur? 

Yea 

No 

Not sure 

5. What is your currea class sunding? 

Freshman 

^Sophomore 

^Junior 

^Senior 

O ther: 

6. Were you interviewed during this semester, by your instructor or by 
another faculty member, about your experiences for the * Partners in 
Learning* Program? 

Yes No 



7 . Studenu have differeot likea when it cornea to class structure aiuf teaching style. Please look over the two phrases at each letter below and mark an in the 
scale closest to the end most like your choice. For example, in item A if you like essay tests much more than multiple choice tests, you would place an X on the 
far left side; if you don't one phrase more than the other or if you like them both the same amount, you would place an X in the middle. 

A. Essay tesu : : : : : True-false or multiple choice testa 

B. Required Attendance for class : : ’ ’ : A tt e n da n ce not required 



C. Doing a project with several : ’ : : • • Doing a project by yourself 

others in the class 



D. Professors who leave it up to 
you to keep up with 

your work 

E. A class that presenu a clear 
point of view 



Professors who often check up on 

you to make sure that your 

work is being done properly and on time 

A class that presents different points 
of view and leaves it up to you to 
develop your own point of view 



F. A class that stresses your : : : : : : A class that stresses clear requirements 

independence even though the even though it may restrict your independence 

assignments may be vague and 

you are unsure of what's expected 

G. Lecture classes : : : : : ^ Discussion classes 



8. We are interested in how you relate to faculty on this campus. How often have you done each of the following with the faculty member teaching th^s course since 
the beginning of the semester? 



Three Times or More- 
Twice 

Once 

Neve r 

A. Socialized informally 

B. Discussed your career plans and 0 12 3 

opportunities 

C. Discussed a persoiul problem 0 12 3 

D. Discussed scademic issues outside 0 12 3 

of class 
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E. Discussed and received helpful 
feedback on your tesu, assigiunenu, and/or 
academic work 



0 12 3 
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Part n. Experiences in this course 



9. Lifted below ere verioue tenieocei ibout thii coune end iti initnicior . 
Plcisc show the exuni to which you igree or diugree with each by circling 
the number ihet bett fits your inewer. 1 =* strong disagreement and 5 =* 
strong agreement. 

Agree Strongly^ 

Agree 

Neither Agree Nor Diaa free 

Disa g r ee 

Disagree Strongly 



A. The presentation of material in this 1 2 3 4 5 

course ia well organized. 



Agree Strongly 

Agree - 

Neither Agree Nor Disagree* 
Disagree 



Disagree Strongly 


1 

1 

■ i 1 




T. Hie instructor does not use class time 


■ 1 1 

12 3- 


♦ 5 


efncientiy. 






U. Hie instructor assigns a reasonable amount 


1 2 3 • 


♦ 5 


of work to the class. 







B. Tne instructor keeps studenu informed 
of their progress. 


1 2 3 4 5 


C. I am developing more confidence in 
myself because of this class. 


1 2 3 4 5 


D. The instructor checks to see if 
understand before going on to new things. 


1 2 3 4 5 


E. I feel I am not performing up to my 
potential in this course. 


1 2 3 4 5 


F. Hie instructor often points out practical 
applications and concepts. 


1 2 3 4 5 


G. Students in this course are free to 
disagree and ask questions. 


1 2 3 4 5 


H. This course requires my best intellectual 
effort. 


1 2 3 4 5 


I. Hie instructor gives individual attention 
to studenu in the class. 


1 2 3 4 5 


J. Hie instructor asks for more than studenu 
can get done. 


1 2 3 4 5 


K. I like this subject more because of taking 
this class. 


1 2 3 4 5 


L. Hirough this course I am learning to know 
the main poinu and central issues in this field. 


1 2 3 4 5 


M. Hie instructor ia not willing to meet and help 
studenu outside class. 


1 2 3 4 5 


N. I have a strong desire to take this course. 


1 2 3 4 5 


O. I am gaining a better understtsding of myself 
through this course. 


1 2 3 4 5 


P. The instructor criticizes studenu when they 
make errors. 


1 2 3 4 5 


Q. Hie instructor is receptive to discussion 


1 2 3 4 5 



outside class. 

R. The inAnictor motivates me to do my beat work. 1 2 3 4 5 



V . Hie instructor uses studenu* questioiu 
and ideas in the lecture. 


12 3 4 5 


W. The instructor has teacher-student discussions 
as opposed to just question-answer sessions. 


12 3 4 5 


X. I am increasing my awareness of my own 
interesu and ulenu through this course. 


1 2 3 4 5 


Y. The instructor makes good use of examples 
and illustrations to get across 
difficult poinu. 


1 2 3 4 5 


Z. The instructor praises studenu for good ideas. 


1 2 3 4 5 


AA. I am interested in doing ouuide reading 
about the course material. 


1 2 3 4 5 


BB. The instructor's explarutiona are unclear. 


1 2 3 4 5 


CC. I am learning to apply principles from 
this coune to new situations. 


1 2 3 4 5 


DD. The instructor suggesU specific ways 
students can improve. 


1 2 3 4 5 


££. Hie instructor shows a genuine concern 
for students. 


1 2 3 4 5 


FF. Course requiremenu are clear. 


1 2 3 4 5 


GG. The instructor uses concrete, everyday 
examples to explain concepu and principles. 


1 2 3 4 5 


HH. The instructor doesn’t really listen to 
what studenu have to say. 


1 2 3 4 5 


n. I am stimulated to discuss related topics 
ouuide of class. 


1 2 3 4 5 


JJ, I feel free to ask questions or express 
my opinions. 


1 2 3 4 5 


KK. The instructor often fails to define new 
or unfamiliar terms. 


1 2 3 4 5 


LL. The instructor encourages student commenu 
even when they turn out to be incorrect or 
or irrelevant. 


1 2 3 4 5 



S. The instructor relates course material to real 1 2 3 4 5 
life situations. 



ERIC 



BEST COPY AVAILABLE 



!0. Pleiie lilt up to three wiyt in which you htve chtnged beciuse of thii dm (e.g. developed new ikillt, changed world view, grt leia imereited in the subject, 
behave dilTerently, etc.). (If there have been no changes, uy so). 



1 1 . Listed below are some statements teachers have used to describe the most important things they do to assist student learning. Please circle the appropriate number 
in the first column to show the extent to which the instructor of this course did these things, and in column 2, circle the number which shows how helpful you think 
the action is in helping ^ou learn. 



The instnictor As a way to help me 

did this: learn, this is: 



A. Encourages student criticism of instructor's ideas 




Very Helpful 

Often Helpful 

Somewhat Helpful — 

Not Helpful 

Not At Ail Helpful — 1 



B. Provides extra help seuions 



1 2 3 4 5 



1 2 3 4 5 



C. Encourages students to discuss ideas that go beyond class 1 2 3 4 5 

readings 



2 3 4 5 



D. Provides structure to clarify the course material 

E. Finds ways to motivate or interest students 

F. Shows enthusiasm for the subject 

G. Relies primarily on classroom discussion as a teaching 
technique 

H. Shows personal concam and empathy for students 

I. Tries to provide a role model for studenu 

J. Frequently departs from prepared nuteriala during 
class to purwe questions or comments from students 

K. Uses a variety of teachmg methods (eg. small group 
activities, studem presenutions, etc.). 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
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12. Lined below are a variety of academic akilla and talents that can be improved or strengthened through particuUr clasaea. Please circle the number which best 

maichea (I) the amoum of progreu you feel you have made in each of these areas as a resuU of jhis course, and a) how imponara this skiU is to you and your goals 
for college. ’ 



Amount of Progreu 

You've Achieved 

■■ 1 ResuU of Thii Course 



Much Progreu 
Some Progreu i 

Little Progre u j 

No Progreu 

A. Factual knowledge ; icquihng new terms, 12 3 4 

methods, or information 

12 3 4 
12 3 4 



12 3 4 



12 3 4 



12 3 4 



B. Skills Trainin 2 : learning specific tasks or 
professional *lciiu 

C. Principles: learning new theories, generalizations, 
and ways of organizing information 

D. Application : learning how to use new information, 
concepts, and methods to solve current problenu 

E. Creativity: developing creative capacities — learning 
to be more expresaive or learning how to approach and 
solve problems in a new way 

F. Appreciation : gaining greater sensitivity to specific 
intellectual, scientific « or artistic endeavors 



Self-Undersunding : acquiring a better unse of myulf 12 3 4 
and/or relationships with others 

H. Self-Management : learning how to plan more effectively 12 3 4 
for and/or control personal, academic, and/or 
profeuional life 

L Critical Thinking : improving my rational thinking, 12 3 4 

problem solving, and decision making capacity 

J. Communication : developing skill in expreuing myself 12 3 4 
orally or in writing 




Importance of 
Skill to ^ 

Very Imporum^ 

Somewhat ^**Tponsnt — j 

Not Very Imporunt | 

Not At Ail Imporunt | 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 
12 3 4 
12 3 4 

12 3 4 
12 3 4 



Appendix D 

Classroom Observation Protocol 



INSTRUCTOR: 



OBSERVATION DATE. 



CONCEPT ARENA AND tt'FMc; 



Teaching behaviors that serve 
concepts and principles. 



NUMBER OF TTMF.t; 

OBSERVED 

N=Never 

R=Rarely 

S=Sometimes 

0=0ften 

A=Almost Always 

to explain or clarify 



1. Gives several examples of 
each concept 

2. Uses concrete, everyday examples to 

concepts and principles 

3. Fails to define new or unfamiliar terms (g} 

4. Repeats difficult ideas several times n 

5. Stresses most important points by pausina 

speaking slowly, raising voice, 
repeating words, etc. m 



N 







0 

0 

o 

0 

0 



6. Points out practical applications of 

% R S O 

7. Answers students' questions thoroughly N R s O 

8. Writes key terms on board or overhead. N R s 0 

9. Explains subject matter in familiar, 

colloquial language S) R S 0 



A 

A ^ 

A 

A 

A 

A 

A 

A V 



ENTHUSIASM: usa of nonverbal behavior to solicit 
and interest. 



student attention 



10. Speaks in a "dramatic" or 
expressive way 



N R 0 0 A 



11. Avoids eye contact with students 

12. Reads lecture verbatim from prepared 

notes or text 



^ R 



S O A 

S O A 



INTERACTION: Techniques used to foster student participation in 
class. 



13. Encourages students to ask questions 
or make comments 



N 



14. Criticizes students when they ^ 

make errors ^ R 

15. Praises students for good ideas N R 

16. Asks questions of individual students R 

17. Asks questions of class as a whole N R 

18 . Incorporates students ' ideas and 

questions into lecture - R 

19. Presents challenging, thought- 

provoking ideas N R 

20. Uses a variety of media and activities 

in class R 



ORGANIZATION: Teaching behaviors that serve to 

organize the sxibject matter. 



21. Reviews topics covered in previous 

lecture at beginning of class 

22. Gives preliminary overview of lecture 

at beginning of class 

23. Uses headings and subheadings to 

organize lectures 

24. Clearly indicates transition from one 

topic to the next 

25. Explains how each topic fits into the 

course as a whole 

26. Periodically summarizes points 

previously made 

27. Refers to and integrates previous 

topics into the lecture. 



Ci^ 

& 



N 



N 



R 



R 



R 



R 



ipy ( e ? 






N 



R 



R 



0 A 

S 0 A 

-Cp 0 A 

S 0 A 




S 0 A 



0 A 
S 0 A 

Structure or 



S 0 A 

S 0 A 

S 0 ■ ^ 



S ^ A 

S 0 A 



J. .0 



S 0 A 




0 



A 



pacing: Rate of presentation of information^ efficient use of class 
time. 



23. Dwells excessively on obvious points 

29. Digresses from major theme of lecture 

30. Asks if students understand before 

proceeding to next topic 

31. Sticks to the point in answering 
students ' questions 




S 0 A 

S 0 A 



N R 




A 



N R S 0 A 



DISCLOSURE: Explicitness concerning course requirements and 

grading criteria. 



32. Advises students as to how to 
prepare for tests and exams 



N R S 0 A 



33. Tells students exactly what is expected 

of them on tests, essays, or assignments N R S 0 A 

34. States objectives of the lecture N R S 0 A 

RAPPORT: Quality of interpersonal relations between teacher and 
students 



35. Addresses individual students by name N 

36. Announces availability for consultation 

outside of class N 

37. Offers to help students with problems N 

38. Shows tolerance of other points of view N 

39. Talks with students before or after 

class 



R S 

* 

R 'S 

R S 

R S 

R . S 



0 A 

0 A 

0 A 

0 A 

0 A 



COMMENTS /NOTES REGARDING CLASS OBSERVED: 

A . . . 




O 



7 



Appendix £ 
Syllabi Analysis 



Syllabus Checklist 

Instructor ID # Semester/Year 

Personal or Departmental Syllabus (P/D) 



Course 



1. 


course title and number 


22. 


required special eyents 


2. 


location of classroom 




noted (yisiting speakers. 


3. 


days/hours of meetings 




field trips) 


4. 


pre- or co-requisites 


23. 


major exams & dates clearly 








Indicated 




Instructor 


24. 


types of exams (objectiye or 


5. 


name of instructor 




essay: comprehensiye) 


6. 


office number 


25. 


quizzes & dates clearly 


7. 


office hours 




indicated 


8. 


office hours: special 








appointments for 




Classroom Participation Policies 




counseling, extra help 


26. 


attendance/tardiness 


9. 


office phone 


27. 


anticipated absences (for 


10 . 


home phone 




rescheduling) 


11. 


name of teaching 


28. 


class participation 




assistant(s) 


29. 


missed exams/assignments. 


12. 


address/phone of teaching 




and opportunities to make 




assistant(s) 




up the work 






29. 


extra credit opportunities 




Texts and Materials 






13. 


required texts (authors, 




Grading 




editions) 


30. 


grading scheme clearly 


14. 


supplementary or 




noted 




recommended readings 


31. 


accommodations: curve. 


15. 


other materials (supplies) 




dropping lowest grade 






32. 


policy on academic honesty 




Learning Objectives 




and plagiarism 


16. 


course description 






17. 


course learning objectiyes 




Availability of Academic Support 






33. 


instructor’s tutorials &/or 




Course Calendar/Schedule 




study guides 


18. 


daily/weekly schedule of 


34. 


departmental tutorials &/or 




topics 




study guides 


19. 


daily/weekly schedule of 


35. 


campus support services 




readings and homework 






20. 


topical schedule (no dates 




Special Instructions (Discipline- 




specified) 




Specific) 


21. 


major assignments (papers, 


36. 


special attendance 




projects) & due dates 




requirements, unusual 




clearly Indicated 




expectations 






37. 


lab requirements 






38. 


special lab reports 
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Appendix F 
Faculty Survey 



Partners in Learning: The Faculty Member’s Experience 



Thii lurvey ii divided into three piiu. In the Cm pert we iik you to respond to questions legsrding your focal class in the Partners in Learning 
Program (i.c, the iniroductory coune you leach that your partner observei). 

The queiiiona in the lecond part were developed bated on previoui itudiei of faculty memben and are included to give ua a aense ot how our 
faculty sample comparea to the gener^ faculty population. 

The third pan aaka questions about your experiencea in the PIL Program. 

Thank you for your participation. 



Instrnctioiis: Unleaa otherwiae indicated* pleaae circle the appropriate number for the category you choose. 



Part I. These queationa focus on your 'focar clau for the FIPSE study. Pleaae answer them with that introductory course in mind. 

I . Please indicate the extent to which you believe each of the following tjrpes of learning is an imponant goal for this (your focal) course. 
Use the "extremely imporunt* category only for those skills/leaming types that are your primary goala for thia course. 



Extremely iinporunt (primary goal)- 
Imponant 



Somewhat Important ■ 
Not Very Important 
Not Important 



a. Factual knowledge : acquiring new terms* methods, or information 

b. Skilla Traininn : learning specific tasks or professional skilla 

c. Principles : learning new theories* generalizations* and waya of organizing information 

d. Application : learning how to use new information* concepts* and methods to solve 
current problems 

e. Creativity : developing creative capacities - learning to be more expressive or learning how 
to approach and solve problems in a new way 

f. Appreciation : gaining greater sensitivity to specific intellectual* scientific* 
or aruAtc endeavors 

g. Self-Understanding : acquiring a better sense of myself and/or relationahipa with others 

h. Self-Management : learning how to plan more effectively for and/or control personal* 
academic* and/or profesiional life 

i. Critical Thinking : improving rstional thinking* problem solving* 

and decision making capacity 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



j. Communication : developing skill in expressing oneself orally or in writing 



1 2 3 4 5 
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A vou us£ in vouf locti cUii. P CMC ulc ihc ticmi and acale below lo 

^ We ere inierr««d in ihe injuucuonai poiiciea and proceourca you use in your w u u ^ r . - 

“• "*•***“ 1 .nnnrocedurea for this coursewguidM|. If you use both enda of ihe conunuum 

u/here on the continuum vour mstni c nonai policies ano proceourea lor mia cou rse 7 

equally, indicate ihia by marking the middle category. Please be sure to mark each scale with an X. 



a. Essay leAs 



b. R^uired Attendance for ciau 



True-false or multiple choice tesu 
Aoendance not required 



c. Studema do projects with several 
others in the clau 



Studenta do projects on their own 



d. Leaving it up to the students 
to keep up in the work 



e. An approach that preaeitta a clear 
point of view 



Regularly checking up on the soideitta 
to make sure that their work ia being 
done properly and on time 

An approach that preaenu different 
perapcctivea aivi leaves it up to the student 
to develop her/his own point of view 



f. My class stresaea the student’s 

independence even though 

aasignmenta may be vague and the 

student unaire of what’a expected of her/him 



My clau stresaea clear requiremenu 
even though it may restrict the student’s 
independence 



g. Lecture claaaea 



Discussion classes 



3 . To wh.t extent do you believe the following teeching ecuvitie. ere (I) DescriEtive of your teeching for your f^l couree. end (2) 
Important tor student motivation . (1 = not at all, 10 = extremely) 



a. Stimulate student interest 

b. Present material 
enthusiastically 

c. Meet course objectives 

d. Be respecthil of students 

e. Motivate students to attain 
high standards 

f. Be prepared and organized 

g. Be intellectually 
challenging 

h. Promote communication between 
instiucior and students 



Descriptive of your 
Teaching in this course 

123456789 10 

123456789 10 

123456789 10 
1 2 3 4 5 6 7 8 9 10 
123456789 10 

123456789 10 
12 3 456789 10 

123456789 10 



Important for 
student motivation 

123456789 10 

123456789 10 

123456789 10 
123456789 10 
123456789 10 

123456789 10 
123456789 10 

123456789 10 



5. What are two or three things about this course you would like to work on the next time you teach it? 
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Part II. The quenoof in ihii pin locui more broialy on you. your preierencei. ind your viewi on leaching improvemernind itudeni learning. 



4. Do your inieteaa lie primarily in l e ac hin g or in reiearch? 



1 . Very heavily in research 

2. In both, but leaning lowtnia research 

3 . In both, but leaning towsrds leaching 

4. Very heavily in leacning 



5. Facuhy memben influence studetfa in ■ number of wsys. On the average , how much influence do you believe vou have on 
undergraduate snidenU in each of the following sreas? (1 = A Great Deal, 2 = Quite a Bit, 3 = Some, 4 = Very Little, and 5 = Almost 
None) 



AlmoA None 

Very Little — , j 

Some 

Quite a Bit j 

A Great Deal j j i 

a. Studems’ undemanding of the methods of inquiry 12 3 4 5 

b. Their involvement in classroom discuaston/activiues 12 3 4 5 



c. Their interest/motivation in introductory courses you teach 

d. Decisioiis about their major field of study 

e. Shaping their career plans 

f. Their emotional and social development 



12 3 4 5 
1 2 3 4 5 
12 3 4 5 
1 2 3 4 5 



g. Their personal philosophy and outlook 
on life 



12 3 4 5 



6. Please read the statemenu about teaching techniques below. On the first scale indicate how characteristic the statement is of you, and 
on the second scale indicate how effective you think the technique is in improving a faculty member’s teaching perfonnance. (1 = not at 
all, 4 = very) 

Characteristic of You Effective for 

Improving Performance 



Very Characteristic 

Somewhat Characteristic 

Not Very Characteristic 

Not At All Characteristic — r 



a. Sharing ideas about teaching methods with colleagues 12 3 4 

b. Introducing new teaching methods or procedures 12 3 4 

c. Sharing syllabi with colleagues 12 3 4 

d. Observing each other’s classroom 12 3 4 

e. Attending professional development activities to 12 3 4 

enhance teaching 

f. Incorporating knowledge of different learning styles 12 3 4 

into one’s leaching 

g. Interacting with students outside of class time or 12 3 4 

office hours 

o 



o 




Very Effective 
Somewhat Effective — 

Not Very Effective 

Not At All Effective — | 

12 3 4 
12 3 4 
12 3 4 
12 3 4 
12 3 4 



12 3 4 
12 3 4 



S3 



3 



Part III. Elxperience with PIL 

7a. Think about your focal class. Have you made any adaptations or changes to your teaching ot this course as a 
result of your participation in the FIPSE-PEL project? 

Yes No (go to Question 8) 

7b. If yes, please describe the adaptations or changes youve made and how you teel these changes have atfected the 
overall success of the course. Please be as detailed and specific as possible — this issue ot adaptation is a central 
element of the study. 



8. Please describe any other ways in which you've changed as a result of your participation in PIL (for example -- 
change regarding your understanding of students, and their learning, change regarding your interaction and 
relationship with faculty colleagues). If you do not feel that you have changed, please so indicate. 



THANK YOU FOR YOUR PARTICIPATION. PLEASE ATTACH ANY ADDITIONAL COMMENTS. 
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Appendix G 
Exit Interview 
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FIPSE-PIL EXIT INTERVIEWS 



1. What is your understanding of the PIL program? 



2. Our understanding of the PIL program: teaching becomes more 
student learning centered, teaching becomes a revitalizing experience: 
more collegial, creating learning experiences for faculty. 



3. Share observation feedback. What do you think about it? 



a. these seven areas of variables -- in which areas do you do things 
differently? (concrete examples) 



b. to what extent did the partnering focus on these areas? 



c. to what extent did the opportunity to observe another faculty's 
classroom focus on these areas? 



o 

ERIC 



66 



d. to what extent did the student interviews focus on these areas? 



4. Partnering Relationships ; describe the dynamics of the partnership(s). 



a. how did you partner give you feedback? 



b. what did you do with it (feedback)? 



5. Interviews with Students: what kind of feedback/what is the value of 
feedback from students? What is the most valuable, and what is least 
valuable? 
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a. has your view of students changed over the last three years? 



b. what is the value of interviewing students? 



6. PIL program: would you join a PIL program again knowing what you 
know now? 
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